Overview of INEX 2009 Link the Wiki Track
نویسندگان
چکیده
In the third year of the Link the Wiki track, anchor-to-BEP link discovery has been the focus besides the file-to-file link discovery. There are two collections, Wikipedia and Te Ara, used in 2009 for respective tasks. 5000 topics were randomly selected for the file-to-file task and 33 anchor-to-BEP topics were nominated by the participants. The Te Ara corpus is used for the first time and the participants are encouraged to discover all anchor-to-BEP links for the entire collection. A validation tool for pre-examining the link discovery results was distributed. This helps to make sure the offset of the anchor text is specified correctly. An updated tool was used for manual assessment. Both file-to-file and anchor-to-BEP runs are evaluated against Wikipedia ground-truth. Evaluation results are presented and discussed. Focusbased evaluation will be undertaken using a new anchor-to-BEP metric.
منابع مشابه
Overview of INEX 2008 Link the Wiki Track
The Link the Wiki track at INEX 2008 offered two tasks, file-to-file link discovery and anchor-to-BEP link discovery. In the former 6600 topics were used and in the latter 50 were used. Manual assessment of the anchor-toBEP runs was performed using a tool developed for the purpose. Runs were evaluated using standard precision & recall measures such as MAP and precision / recall graphs. 10 group...
متن کاملOverview of the INEX 2010 Link the Wiki Track
The INEX 2010 Link-the-Wiki track examined link-discovery in the Te Ara collection, a previously unlinked document collection. Te Ara is structured more a digital cultural history than as a set of entities. With no links and no automatic entity identification, previous Link-the-Wiki algorithms could not be used. Assessment was also necessarily manual. In total 29 runs were submitted by 2 instit...
متن کاملOverview of the INEX 2008 Link the Wiki Track
In the third year of the Link the Wiki track, the focus has been shifted to anchor-to-bep link discovery. The participants were encouraged to utilize different technologies to resolve the issue of focused link discovery. Apart from the 2009 Wikipedia collection, the Te Ara collection was introduced for the first time in INEX. For the link the wiki tasks, 5000 file-to-file topics were randomly s...
متن کاملThe University of Amsterdam ( ISLA ) at INEX 2009
We describe our participation in the INEX 2009 Entity Ranking and Link-the-Wiki tracks. We provide a detailed account of the ideas underlying our approaches to these tasks.
متن کاملOverview of INEX 2007 Link the Wiki Track
Wikipedia is becoming ever more popular. Linking between documents is typically provided in similar environments in order to achieve collaborative knowledge sharing. However, this functionality in Wikipedia is not integrated into the document creation process and the quality of automatically generated links has never been quantified. The Link the Wiki (LTW) track at INEX in 2007 aimed at produc...
متن کاملThe University of Amsterdam at INEX 2007
In this paper, we document our efforts at INEX 2007 where we participated in the Ad Hoc Track, the Link the Wiki Track, and the Interactive Track that continued from INEX 2006. Our main aims at INEX 2007 were the following. For the Ad Hoc Track, we investigated the effectiveness of incorporating link evidence into the model, and of a CAS filtering method exploiting the structural hints in the I...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2009